Billiard table lighting

ABSTRACT

A billiard table top lighting apparatus provides substantially uniform lighting across the surface of a billiard table surface. In one form, the lighting apparatus includes a frame supporting lights that are non-centrally placed such that no lights are supported above a middle portion of the billiard table surface. So configured, the frame can have an attractive profile and further mount additional items above the billiard table surface to enable a variety of other features. For example, the frame may support one or more cameras, one or more motion sensors, one or more microphones, and/or one or more computing devices to enable any of a variety of innovative features. Such features could include automatic game play recording from one or more perspectives, merged video track storage for replay, review, and analysis, automatic lighting and dimming control, control of the apparatus from any mobile device, and the like.

RELATED APPLICATION(S)

This application is a continuation of U.S. patent application Ser. No.15/336,062, filed Oct. 27, 2016, to issue as U.S. Pat. No. 11,045,713,which is a continuation of U.S. patent application Ser. No. 14/815,318,filed Jul. 31, 2015, issued as U.S. Pat. No. 9,485,399, which claims thebenefit of U.S. provisional patent application No. 62/032,187, filedAug. 1, 2014, the contents of each of which are incorporated byreference as though fully re-written herein.

TECHNICAL FIELD

This invention relates generally to billiard table lighting and moreparticularly to providing substantially uniform billiard table lightingto facilitate automated game play monitoring including image capture andautomated image and video merging and other associated features.

BACKGROUND

The game of billiards and related table top games have been known formany years. Such games involve movement of balls on a table top.Typically a ball is struck with an instrument such as a cue to move theball around the table top surface for positioning, to strike and moveother balls, and the like. In some variants, balls are struck into holesin or at edges of the table top called pockets. In other variants, ballsare struck so as to contact in a particular way other balls on the tabletop and/or cushions that line the table top to keep the balls on thetable top surface. These games have a variety of names including cuesports, billiards, pool, snooker, pocket billiards, among others. Forclarity and convenience, such games will be referred to collectively asbilliards or billiard.

Generally speaking, the most popular form of billiards involves a numberof colored balls placed on a table. Over many years the sport hasattracted significant public interest as a spectator event and also as apersonal pastime or hobby, similar to golf and tennis. Because of itscolorful nature there has been increased interest in applying modernvideo capture technology and computing and imaging technology to recordor analyze game play. There are available sophisticated methods of videorecording of game play, such as in tournaments or exhibits using boomsor strategically placed cameras, where a director manually dictateswhich camera feed to use during play, and where a remote voicecommentary is fed into the video record. There are also many examples of“do-it yourself” video recording from manually placed cameras, where thefield of view covers the entire table and player activities from adistance and at a perspective view. There have additionally beenattempts to place cameras directly over the table, using image analysisto locate the balls and perform ball tracking, but ignoring the viewareas around the table and player's activities that are the prominentfeatures of the simple recording of game play with video cameras.

Such attempts at video recording and image ball recognition systems,however, fail to be applicable to a wider general audience of billiardgame players. A significant failure of prior attempts is the lack of anintegrated approach to incorporate the lighting of the table, both formsof video recording and an audio record of ball sounds and player voicesinto one approach, at a low cost, and with the ease of use related toone single integrated apparatus.

For instance, to capture sufficiently high quality images of the ballsto allow advanced game play by computerized image analysis, the billiardtable surface should be substantially uniformly lighted. To achieverapid, ball recognition by image analysis the scene segmentation portionof the image analysis procedure is most efficiently accomplished byhaving a flat uniformly lit background. Billiard tables, however, aretypically lit using one or more light sources disposed above a centerportion of the table such that lighting at the edges of the table ismarkedly worse than at the center. Although the World Pool-BilliardAssociation provides the following equipment specifications forlighting, such specifications do not suggest the level of uniformillumination typically needed for imaging projects: “15. Lights The bedand rails of the table must receive at least 520 lux (48 footcandles) oflight at every point. A screen or reflector configuration is advised sothat the center of the table does not receive noticeably more lightingthan the rails and the corners of the table. If the light fixture abovethe table may be moved aside (referee), the minimum height of thefixture should be no lower than 40 inches (1.016 m) above the bed of thetable. If the light fixture above the table is non-movable, the fixtureshould be no lower than 65 inches (1.65 m) above the bed of the table.The intensity of any directed light on the players at the table shouldnot be blinding. Blinding light starts at 5000 lux (465 footcandles)direct view. The rest of the venue (bleachers, etc.) should receive atleast 50 lux (5 footcandles) of light.” Under such specifications,uniform illumination sufficient for imaging analysis is not readilyavailable. As a result, automatic image analysis of balls at table edgescan result in inaccurate ball identification or insufficiently accurateball location determinations. As a result, rapid automatic imageanalysis of ball movement and location cannot be accomplishedefficiently and cost effectively with conventional billiard tablelighting.

Additionally, there is a need to have one video recording of game playthat can simultaneously allow for accurate ball movement and position,such as may be accomplished by image analysis in the plane of the tablesurface but at the same time, in the same video record provide the videoviews of player activity around the near periphery of the table.

SUMMARY

Generally speaking, pursuant to these various embodiments, a billiardtable top lighting apparatus is described that provides substantiallyuniform lighting of a billiard table surface, but also optionallyincludes as an integrated component with multiple devices for recordingand viewing game play embedded in the light structure itself. In oneform, the lighting apparatus includes a frame supporting lights that arenon-centrally placed such that no lights are supported above a middleportion of the billiard table surface. Other lighting configurations arepossible.

So configured, the frame can have an attractive profile and furtherinclude additional items above the billiard table surface to enable avariety of other features. For example, the frame may support one ormore cameras, one or more motion sensors, one or more microphones,and/or one or more computing devices to enable any of a variety ofinnovative features. Such features could include automatic game playrecording from one or more perspectives by multiple cameras,automatically reconstructed, merged video track storage from themultiple camera views for replay, review, and analysis, automaticlighting and dimming control, control of the apparatus from any mobiledevice, and the like. These and other benefits may become clearer uponmaking a thorough review and study of the following detaileddescription.

BRIEF DESCRIPTION OF THE DRAWINGS

The above needs are at least partially met through provision of thebilliard table lighting and game play monitor described in the followingdetailed description, particularly when studied in conjunction with thedrawings, wherein:

FIG. 1 comprises a perspective view of an example lighting apparatusdisposed above a billiard table as configured in accordance with variousembodiments of the invention;

FIG. 2 comprises a top view of a billiard table to illustrate use oftable markers to determine illumination measurement sites;

FIG. 3 comprises a top view of a billiard table to illustrate anotheruse of table markers to determine illumination measurement sites;

FIG. 4 comprises a three-dimensional graph of illumination measurementson a billiard table lit using a prior art lighting apparatus;

FIG. 5 comprises a three-dimensional graph of illumination measurementson a billiard table lit using a lighting apparatus as configured inaccordance with various embodiments of the invention;

FIG. 6 comprises a three-dimensional graph of a simulation ofillumination measurements on a billiard table lit using a lightingapparatus as configured in accordance with various embodiments of theinvention;

FIG. 7 comprises a top view of an example lighting apparatus asconfigured in accordance with various embodiments of the invention;

FIG. 8 comprises a bottom view of the example lighting apparatus of FIG.7 as configured in accordance with various embodiments of the invention;

FIG. 9 comprises a plan view of a light source as used in accordancewith various embodiments of the invention;

FIG. 10 comprises a circuit diagram for the light sources of an examplelighting apparatus as configured in accordance with various embodimentsof the invention;

FIG. 11 comprises a cross-section view of one example of a frame for anexample lighting apparatus mounted above a billiard table in accordancewith various embodiments of the invention;

FIG. 12 comprises a head end perspective view picture of an examplelighting apparatus mounted above a billiard table in accordance withvarious embodiments of the invention;

FIG. 13A comprises an example image captured from a camera mounted abovea middle portion of the billiard table surface in accordance withvarious embodiments of the invention;

FIG. 13B comprises an example image capture in sequence, after the imagefrom FIG. 13A, from a camera mounted above a middle portion of thebilliard table surface in accordance with various embodiments of theinvention;

FIG. 14 comprises an example image captured from a camera mounted abovethe foot end portion of the billiard table surface in accordance withvarious embodiments of the invention;

FIG. 15 comprises a block diagram of an example lighting apparatus incommunication with other devices in accordance with various embodimentsof the invention;

FIG. 16 comprises an example web page operator interface used to turnthe lighting apparatus on or off and to control the light level inaccordance with various embodiments of the invention;

FIG. 17A comprises an example composite image video frame constructed inreal time from the camera mounted above the middle portion of thebilliard table and the camera mounted at the head end of the billiardtable in accordance with various embodiments of the invention;

FIG. 17B comprises an example composite image video frame, similar toFIG. 17A, constructed in real time from the camera mounted above themiddle portion of the billiard table and the camera mounted at the footend of the billiard table in accordance with various embodiments of theinvention;

FIG. 18A comprises an example of two threaded processes executed by thelighting apparatus to asynchronously capture video frames on one threadand to asynchronously perform image processing for a movement in thescene of the captured image on the other thread in accordance withvarious embodiments of the invention;

FIGS. 18BA to 18BB comprise an example of four additional threadedprocesses, similar to those of FIG. 18A, executed by the lightingapparatus to asynchronously capture video frames from two additionalcameras on two additional threads and to asynchronously perform imageprocessing for a movement in the scene of the captured images on theother two additional threads in accordance with various embodiments ofthe invention;

FIGS. 18CA to 18CB comprise an example of two threaded processesexecuted by the lighting apparatus to asynchronously select individualframes of video from three cameras on one thread, to create a compositesingle output video stream for display, and to record the created outputvideo with corresponding audio on the other thread in accordance withvarious embodiments of the invention;

FIG. 19 comprises a flow chart of an example method of execution for alighting apparatus for merging video streams from multiple sources inaccordance with various embodiments of the invention.

Skilled artisans will appreciate that elements in the figures areillustrated for simplicity and clarity and have not necessarily beendrawn to scale. For example, the dimensions and/or relative positioningof some of the elements in the figures may be exaggerated relative toother elements to help to improve understanding of various embodimentsof the present invention. Also, common but well-understood elements thatare useful or necessary in a commercially feasible embodiment are oftennot depicted in order to facilitate a less obstructed view of thesevarious embodiments. It will further be appreciated that certain actionsand/or steps may be described or depicted in a particular order ofoccurrence while those skilled in the art will understand that suchspecificity with respect to sequence is not actually required. It willalso be understood that the terms and expressions used herein have theordinary technical meaning as is accorded to such terms and expressionsby persons skilled in the technical field as set forth above exceptwhere different specific meanings have otherwise been set forth herein.

DETAILED DESCRIPTION

Referring now to the drawings, and in particular to FIG. 1 , anillustrative lighting apparatus 100 for lighting a billiard tablesurface 110 and that is compatible with many of these teachings will nowbe presented. The billiard table surface 110 is supported by a table 115and is bounded by cushions 117 that define the edges of the billiardtable surface. The lighting apparatus 100 includes a frame 120configured to support one or more lights 130 at a spaced distance Zabove the billiard table surface 110. To enable certain of the game playimage capture and analysis features, the one or more lights 130 includea light source or sources mounted in the frame 120 in a configuration toprovide substantially uniform illumination of the billiard table surface110. Although the examples discussed in this disclosure relate tovarious peripheral lighting approaches, it is contemplated that anylighting arrangement for providing uniform illumination can be applied,such as using in any combination strategically placed lights, lensing,reflectors, shades, diffusers, and the like.

The concept of uniform illumination will be discussed further withrespect to FIGS. 2-6 . Different sets of illumination measurements weretaken to confirm the uniform illumination of the disclosed lightingapproach. FIG. 2 illustrates how the table markers labeled 1, 2, and 3at the foot end 210 and 1 through 7 at the table side 220 were used toestablish measurement points 230 on the table surface where projections240 from the table markers intersected. An Extech foot-candle/lux lightmeter was placed at each of the measurement points on a standardbilliard table illuminated by a typical overhead, centered billiardtable light manufactured by Diamond Billiards with no other ambientlight sources on. The illumination measurements at the measurementpoints illustrated in FIG. 2 are listed in both foot-candles and lux inTable 1 below. Table 1 further notes the average illumination (AVG), thecoefficient of variation of the measurements (CV) (which is a normalizedmeasure of dispersion of a probability distribution or frequencydistribution and is defined as the ratio of the standard deviation tothe mean or average), and the standard deviation of the measurements(STD).

TABLE 1 Diamond Billiards Light (in footcandles) 1 2 3 1 81 88 84 STD =17 2 105 109 109 3 119 125 119 AVG = 108 4 125 131 125 5 121 127 122 CV= 15% 6 107 113 106 7 85 89 86 Diamond Billiards Light (in lux) 1 2 3 1870 945 908 STD = 178 2 1130 1176 1170 3 1280 1340 1281 AVG = 1165 41345 1408 1340 5 1305 1366 1310 CV = 15% 6 1147 1212 1142 7 910 958 924

Table 2 lists illumination measurements taken at the same measurementpoints of a billiard table using a light configured in accord with theapproaches of FIGS. 1 and 7-12 with no other ambient light sources on.

TABLE 2 Smart Billiards Light (in footcandles) 1 2 3 1 48 50 49 STD =1.4 2 50 52 51 3 51 52 51 AVG = 51 4 51 52 50 5 52 52 51 CV = 3% 6 51 5250 7 49 50 48 Smart Billiards Light (in lux) 1 2 3 1 515 539 526 STD =15.0 2 541 560 544 3 550 563 549 AVG = 544 4 551 560 543 5 555 563 544CV = 3% 6 553 562 540 7 524 537 512

FIG. 3 illustrates a similar approach to establishing illuminationmeasurement points X except to expand the points X to include theintersection of the marker projections with the cushions 117 todetermine the lighting uniformity for more of the billiard table surface110. The illumination for the table having the standard DiamondBilliards light was re-measured using these measurement points withresults shown in Table 3 below and in FIG. 4 . Also, measurements weremade on a number of other pool tables with other commonly used centertable lights in two commercial pool establishments in the Chicago areawith similar measurement results to those illustrated in Table 3 below.

TABLE 3 Diamond Billiards Light (Stevensville Jul. 15, 2014) 1 2 3 4 5 148 57 59 57 47 STD = 25.1 2 66 80 86 80 65 3 85 106 109 103 84 AVG =90   4 99 120 124 119 97 5 103 127 131 127 103  CV = 28% 6 99 120 125123 99 7 87 109 113 106 87 8 69 85 88 87 68 9 52 60 63 60 51

The billiard table lighted with the prototype light for which firstmeasurements are listed above also had its illumination re-measured butwith a dimmer set to adjust the average lighting output to closer to thecommercially available Diamond Billiard light using the measurementpoints of FIG. 3 . The results are listed in Table 4 below and areillustrated in FIG. 5 .

TABLE 4 1 2 3 4 5 1 93 99 101 98 90 STD = 6.8 2 100 108 109 106 97 3 103110 111 108 100 AVG = 102 4 102 109 110 108 100 5 103 109 109 107 100 CV = 7% 6 102 109 110 107 99 7 102 109 110 107 98 8 97 105 106 103 93 988 93 95 91 84

To further illustrate this approach, a commercial lighting, ray tracing,simulation program (Photopia software from LTI Optics) was used togenerate simulated illumination levels for a billiard table litaccording to that of Table 4 and FIG. 5 . The simulation results listedbelow in Table 5 and illustrated in FIG. 6 are largely consistent withthe physical illumination measurements separately taken.

TABLE 5 SBL Simulation Pool_08 (Prototype 1, Jul. 19, 2014) 1 2 3 4 5 166 73 75 73 66  STD = 5.9 2 75 81 84 82 75 3 78 85 86 85 78 AVG = 79 479 84 86 85 79 5 78 84 86 85 79  CV = 7% 6 79 84 86 85 80 7 78 84 87 8578 8 74 81 83 82 74 9 67 73 75 73 66

Thus, the arrangements described herein demonstrate substantiallyuniform illumination of the billiard table surface of between about 50and 115 foot-candles. In short, instead of a variance of 15% when usingonly mid-table readings or 28% when including illumination at thecushions, the disclosed lighting apparatus has a coefficient ofvariation of only 3% using the mid-table readings and only 7% when usingillumination at the cushions. In short, the cushion to cushion overallillumination uniformity for the disclosed lighting apparatus was betterthan the mid-table illumination uniformity for a standard billiard tablelight. Accordingly, substantially uniform illumination for the tablewill include an illumination coefficient of variation of about 14% orless, more preferably 10% or less, from cushion to cushion measured atthe locations described above as shown in FIG. 3 .

Turning back to the example lighting approach measured above, and withreference to FIGS. 7-8 , a frame 120 is mounted above the billiard tablesurface with one or more light sources 130 mounted in the frame 120. Thelight source or sources may include light sources 130 mounted in theframe 120 in a configuration around a periphery of the billiard tablesurface 110. The periphery will typically correspond to an areaprojected above the cushions or edges of the billiard table surface 110.For example, the frame 120 can be configured to mount the one or morelights 130 within a given horizontal distance from edges of the billiardtable 110 such as within ten inches of the vertical projection of thecushion's 117 edge, and more preferably within five inches. In oneapproach, the one or more lights are non-centrally placed such that nolight sources are placed approximately directly above a middle portionof the billiard table surface 110. The middle portion of the billiardtable surface 110 will be generally understood to correspond to the areaof the surface 110 between projections of the foot end 210 markers 2 and4 of FIG. 3 from about marker 2 to about marker 8 of the side table 220markers of FIG. 3 .

In one approach, the frame 120 is configured to mount pairs 710 of theone or more lights 130 in a generally perpendicular configuration aboveeach corner of the billiard table surface 110. In a further aspect, theframe 120 is configured to mount two of the one or more lights 130generally equally spaced along each long side of billiard table surface110 as illustrated in FIG. 1 . The frame 120 may further include amiddle frame portion 720 spanning across a middle portion 160 of theframe 120 corresponding to a middle portion of the billiard tablesurface 110 when mounted above the billiard table surface 110.

The light sources 130 can comprise any suitable light source. In theillustrated examples, the light sources 130 each include a set of lightemitting diode (LED) lights 930 mounted in a linear configuration suchas illustrated in FIG. 9 . In this example, the light source 130 is anoff the shelf light bar manufactured by PHILIPS having a mountingsurface 940 on which the LED lights 930 are mounted, here in a linearconfiguration only, although additional LED lights could be mounted inaddition to those set in a linear configuration. Mounting holes 950 inthe mounting surface 940 facilitate mounting of the light source 130 tothe frame 120. Electrical connectors 960 allow for wired connections toa power source or driver or to another light source 130 such that onepower source or driver can power and drive more than one light source130.

FIG. 10 illustrates an example driver or power circuit for powering thelight sources 130 of the lighting apparatus, in this example, a PHILIPSXITANIUM 75 W 0.7-2.0 A 0-10V dimming device. Here, the light sources130 are divided into two groups with each group having its own otherwiseidentical circuit 1010 and 1012. Each circuit in turn includes a powersource 1020, resistor 1030, and rheostat 1040 connected in series withthe light sources 130. The rheostat 1040 controls the amount of currentflowing through the LED light sources 130 thereby controlling thebrightness of the lights as a group. Alternatively, and as is well knownin the art, a pulse width modulation (PWM) circuit may be used tomodulate the light intensity.

Generally speaking, the frame 120 further supports shades, reflectors,or the like to direct light from the light sources 130 to the billiardtable surface and protect the players' eyes from direct exposure to theLEDs. Alternatively or in addition, one or more reflectors and/or adiffuser element can be added to diffuse the light from the LEDs andprovide a more uniform aesthetic. In the example design of the frame's1120 internal portion illustrated in FIG. 11 , the frame 1120 is in theshape of a troffer, i.e., a narrow inverted trough, serving as a lightsource support, reflector, and holder of diffusers. The troffer frame1120 is substantially hollow in its inner structure, which is configuredto support one or more lights by a top portion or upper supportconstruction 1124 of the inner structure opposing a portion of thetroffer frame closest to the billiard table surface when installed.Opposing sides of the troffer frame 1120 extend down from the topportion encasing the lights and support reflective surfaces. Theillustrated example is constructed from extruded aluminum and hascontinuous t-slots along the length of the top surface and insidesurface to provide attachment points for supports to mount the frame toroom ceilings, and for the attachment of video cameras 750, or otherdevices. The t-slots accommodate a t-slot nut and screw/bolt 1122 whichslides along the t-slot track to aid various attachments. The frame'supper support construction 1124 supports the lighting elements (here anLED circuit board 1140 supporting LEDs 1130) to face in the direction ofthe table surface. In this example, the LEDs 1130 are supported to faceessentially straight down, in other words, such that the plane in whichthe LEDs 1130 are supports is essentially horizontal with the tablesurface although other arrangements are possible. Light from the LED's1130, however, emits in a variety of directions and can be distractinglybright in one's field of view.

To spread the light and allow a player to play without distraction fromthe LEDs 1130, the frame 1120 supports one or more diffusers. In theillustrated example of FIG. 11 , a particular diffuser arrangement isillustrated that redirects light rays from the LED 1130 that wouldotherwise be absorbed by the frame or be directed in a manner to not hitthe table, so as to adequately light the billiard table surface andstill diffuse light from the LEDs 1130, and so as to not be distractingto a player. In this example, a first mirrored diffuser 1150 is disposedbetween the light source or sources (such as LED 1130) and an outer wall1126 of the frame 1120 that faces away from the center of the billiardtable surface. The back surface 1155 is mirrored and the rest of thethicker portion of the diffuser 1150 is constructed from a substancethat diffuses the reflected light, both before and after reflection bythe mirrored surface 1155. The width of the diffuser 1150 is orientedessentially perpendicular with the billiard table surface so that themirrored surface 1155 of the diffuser 1150 reflects light toward thecenter of the billiard table to help provide adequate lighting of thetable surface. In one approach, this diffuser 1150 is a commerciallyavailable diffuser (Evonik Platinum Ice OM001 X1) and is 0.34 inchthick. For the aluminum extrusion of the design illustrated in FIG. 11 ,the mirrored diffusor is 1.8 inches from top to bottom in the crosssection of FIG. 11 and, for a standard size 9 foot pocket billiardtable, is 95.8 inches along the sides of the frame and is 45.8 inchesalong the ends of the frame. Other lengths are possible.

A bottom diffuser 1160 is supported to be disposed between the lightsource or sources (such as LED 1130) and the billiard table surface. Inthis example, the bottom diffuser 1160 is a commercially availablediffuser (Evonik Satin Ice OD002 DF) that is 0.08 inch thick and 2.125inches wide. This diffuser 1160 diffuses the LED's 1130 light so thatgame players will not be distracted by the strong light that can emanatefrom individual LEDs. Instead, the observed light is diffused to providea more uniform appearing light. This diffusing also spreads the light isa more uniform manner across the table surface. In addition, the bottomdiffuser 1160 protects the LEDs 1130 from being struck by a cue.

A second mirrored diffuser 1170 is disposed between the light source orsources (such as LED 1130) and an inner wall 1128 of the frame 1120 thatfaces toward the center of the billiard table surface. The inner wall1128 may define a t-slot channel 1129 which optionally supportsadditional elements such as one or more cameras, motion sensors, or thelighting apparatus's middle section 160. In this example, the secondmirrored diffuser 1160 is a commercially available diffuser (EvonikPlatinum Ice OM001 X1) that is 0.118 inch thick, 1.3 inches wide, and,for a standard size 9 foot pocket billiard table, is 95.8 inches alongthe sides of the frame and is 45.8 inches along the ends of the frame.Other lengths are possible. The second mirrored diffuser 1170 isdisposed at an angle so that its mirrored surface 1175 reflects lightgenerally toward both the bottom diffuser 1160 and the first mirroreddiffuser 1150 to effect direction of more light at the billiard tablesurface through the bottom diffuser 1160 and via additional reflectionoff of the first mirrored diffuser 1140. The diffusers 1150, 1160, and1170 extend at least the length of the frame 1120 corresponding to alength of the frame along which the LED's 130 are supported although thediffusers 1150, 1160, and 1170 can extend any length along the frame.Typically, for example, the bottom diffuser 1160 will extend around theentire frame 1120 to provide a more uniform aesthetic for the frame1120.

An example implementation of the frame 1120 as installed above abilliard table is illustrated in FIG. 12 , where the combined internalframe mirror and diffuser configuration smooth's out the light from theLEDs creating an aesthetic, even illumination on the table surface.

Referring again to FIGS. 7 and 8 , the middle frame portion 720 may beconfigured to support a variety of other elements to add a variety offeatures to the lighting apparatus. For example, all or some of theelectrical and/or computing elements needed to provide a variety offunction can be mounted on the middle frame portion 720 top side to benot visible to the players. In one application, an A/C power strip 722is mounted to the middle frame portion 720 to provide outlet power tovarious elements. An A/C switch 724 provides a master power switch forthe lighting apparatus 100.

In one aspect, the middle portion 720 of the frame 120 supports a middlecamera 730 directed to record images of the billiard table surface 110.The camera 730 may be mounted so that the image sensor is in a planeessentially parallel to the table surface and high enough above thetable such that the camera lens projects the entire table surface areaonto its image sensor. If necessary, depending on the camera lens andimage sensor size, and to keep the distance Z in FIG. 1 within apreferred height, the light path from the table to the camera may bedeflected with a 45 degree mirror or similar optical arrangement, sothat the image sensor is perpendicular to the table surface. In effectthe light path distance is made adjustable within the middle portion ofthe frame 720, horizontally, so as not to alter the preferred height ofthe frame above the table, but to still obtain a mapping of the completetable surface area onto the image sensor. In either configuration, oneframe of video from middle camera 730 maps the entire table surface ontothe image sensor for rapid and efficient image processing purposes. Theimage processing of the table surface single frames is made even moreefficient by the controlled uniform illumination provided by thelighting apparatus.

FIGS. 13A-B show example images captured by the middle camera 730. Thelighting apparatus as further described herein may include a processingdevice 745 in operative communication to receive the images recorded bythe middle camera 730. Those skilled in the art will recognize andappreciate that such a processor device can comprise a fixed-purposehard-wired platform or can comprise a partially or wholly programmableplatform. All of these architectural options are well known andunderstood in the art and require no further description here. Soconfigured, the processing device 745, and as further described herein,can also be configured to determine whether balls on the billiard tablesurface 110 are in motion or non-motion based on the images recorded bythe middle camera 730, such as by using image by image comparisontechniques or by using object identification of billiard balls on aframe by frame comparison basis to track the ball motion between frames.Then, the processing device 745 can automatically control a setting forthe lighting apparatus 100 based at least in part on the balls beingeither in motion or non-motion. For example, in response to determiningnon-motion of balls on the billiard table surface, the processing device745 effects stopping recording or provision of images from the middlecamera 730. Thus, the processing device 745 and middle camera 730 canwork together to operate efficiently because there is no reason tocontinue to transmit or record images of the billiard table surface 110when image does not change, i.e., in between shots by the players. Inone approach, the processing device 745 effects provision of images fromthe middle camera 730 and from the end cameras 750 to reconstruct a realtime or recorded video record from the combination of cameras asdescribed herein.

Similarly, in one example, the processing device 745 is configured todetect particular images in the field of view of the middle camera 730,in response to which, the processing device 745 can effect starting,stopping, or pausing recording or provision of images. For example, acard having a particular image could be placed on the billiard tablesurface so as to be in the middle camera's 730 field of view or aparticular hand gesture may be made over the table surface. Depending onwhich particular image is detected, the processing device 745 may reactin particular corresponding ways. For example, in response to detectingone particular image (such as a large red dot on a card or other uniqueindicator), the processing device 745 can automatically stop executionof the program relating to the monitored game. In this way, players canreadily “pause” the program in the middle of game play because theprocessing device 740 can automatically restart the program in responseto detecting removal of the particular image. Similarly, the processingdevice 745 may automatically start recording of a “new” game in responseto detecting a particular image associated with that action such as alarge green dot on a card.

In an additional aspect, an end portion of the frame 120 correspondingto a head or foot end portion of the billiard table surface 110 whenmounted above the billiard table surface 110 can support an end camera750 directed to record images of at least a portion of the billiardtable surface 110 and an area surrounding a head or foot end portion ofthe billiard table surface 110 opposite that over which the end camera750 is mounted. FIG. 14 shows an example of an image captured by an endcamera 750. As illustrated in FIGS. 7 and 8 , the frame 120 can supportend cameras 750 at both the head and foot ends to capture images of bothends of the table. The end cameras 750 provide video images of playermovement around the table and the player's approach to a shot. Suchimages can be useful for real time viewing, recording or transmission.As further described herein the images can also be used to constructcomposite video frames together with the table view image framesobtained simultaneously by the middle camera 730.

Motion sensors 760 can be used to facilitate operation of the lightingapparatus. In this respect, the processing device 740 can be inoperative communication with the motion sensor 760 to automaticallycontrol a setting for the lighting apparatus in response to detection ofmotion. In one example, the processing device 740 may be configured topower off the plurality of lights 130 automatically in response to themotion sensor's 760 failing to detect motion for a threshold set timeperiod by electronically communicating with an A/C switch circuit 724.Similarly, the processing device 740 may be configured to increase thelighting level by communicating with a pulse width modulation circuit1040, going from dimmed to a brightness sufficient to enable imagecapture and recording as described herein. In another example, theprocessing device 740 may be configured to provide images from a firstcamera in response to detecting motion from a first motion sensor and toprovide images from a second camera in response to detecting motion froma second motion sensor. For instance, video or images will be recordedor transmitted from a camera oriented to capture images from an areafrom which motion is detected to ensure that the player movement isautomatically recorded or transmitted.

In still another aspect, the processing device 745 may be configured tomonitor sound captured by a microphone 770 to detect a strike soundhaving characteristics of a cue striking a billiard ball, and inresponse to detecting the strike sound, to automatically control asetting for the lighting apparatus 100. The microphone 770 may bemounted to the frame 120 or be a part of another device (such as one ofthe video cameras) that is in communication with the processing device745. Furthermore, the processing device can be configured to, inresponse to detecting the strike sound, start recording or provision ofimages from the middle camera 730 mounted on the middle frame portion720 of the frame 120 to automatically capture images of the movingballs.

The above elements can be combined in a variety of ways to provide manycombinations of automated and/or remotely controlled features. One suchfeature is the ability to completely control the lighting apparatus andrecord images from the cameras 730 and 750 from mobile deviceswirelessly communicating with the lighting apparatus 100. Generallyspeaking, a processing device is configured to communicate with a usercommunication device, here the mobile device 1510 although other devicescould be used, to provide images from the one or more cameras 730 and750 disposed to capture images of the billiard table surface 110 and/orareas surrounding the billiard table surface 110. In other approaches,the processing device may communicate directly with the usercommunication device. The processing device may then communicate with atleast two cameras of the one or more cameras 730 and 750 to coordinatestorage of the images or provision of the images to the usercommunication device 1510. One such example arrangement is illustratedin FIG. 15 , utilizing first and second processing devices 740 and 745(Computer 1 and Computer 2 respectively in FIG. 15 ) where the firstprocessing device 740 is operating the lighting apparatus to turn on,adjust the brightness, and start game play, and where the secondprocessing device 745 is dedicated to communications with the cameras730 and 750 to facilitate selection of the cameras from which individualvideo streams will be stored and/or provided to a user communicationdevice 1510. The second processing device 745 is in operativecommunication with the first processing device 740 via the wiredconnection 742 (such as an Ethernet or similar method) to receivecommands with respect to starting and stopping the viewing or recordingof images. Here, a generally available router device 1520 can coordinatewireless communication such as through WiFi between the mobile device1510 and the processing device 740 of the lighting apparatus 100. Inthis example, the processing device 745 operates a server that hosts aweb page operated from the mobile device 1510. One example of the webpage is shown in FIG. 16 . The server is assigned a local IP address bythe router 1520, and the IP address is displayed in the LCD panel 1560.The mobile device 1510 interacts through the web page to control thelight and allows the user to turn the light on or off by clicking thebutton 1720. The web page interface also allows the user to adjust thelight level by clicking on one of a series of bars 1730 in theinterface. Clicking higher on the screen provides a higher light levelthat is indicated by the bar 1740 moving up. The web page of FIG. 16allows control of the lamp on/off and intensity through a backgroundprogram running on the processing device 1641 interfaced via the webpage to either switch power on or off through the A/C switch 724 fromthe processing device 1641 to the lamp circuit, or in the case ofadjusting the intensity, by controlling a pulse width modulation circuitinterface to the lamp power supplies 1020.

Additionally, the background program monitors the motion detectors 760and adjusts the light intensity according to whether there is motion inthe field of view of the motion detectors. As long as motion is presentthe lamp stays at the level set by the user. If there is no motion for apreset period, then the lamp automatically dims to a lower level usingthe pulse width modulation control. If there continues to be no motionfor an additional preset period, the lamp turns off through the poweron/off switch.

In another example of the various uses of the components of the FIG. 15, the second processor 745 is operated by the display screen, keyboard,and mouse 1685 to run a software program to display in real time (e.g.,30 frames per second) an automatically generated composite video thatcombines the output from all three video cameras 730 and 750. Thecomposite video may optionally be recorded for later retrieval andreview. The video is a recording, reproducing, or displaying of visualimages made digitally of a scene captured sequentially in time, suchthat they can be viewed as moving visual images, even if there is noapparent motion for certain periods. By one approach, the method ofcreating a video of billiard game play recorded simultaneously frommultiple video cameras includes operating at least three independentimage capture threads individually associated with separate camerasasynchronously in a same time interval. The independent image capturethreads use shared memory resources and event done flags to communicatewith each other. The independent image capture threads asynchronouslycapture individual image frames from the separate cameras. mage analysisof the captured individual image frames from the separate cameras tocompare the individual image frames from a given camera of the separatecameras to determine which of the individual image frames are recordingmotion in the respective sequence of recordings from the respective onesof the separate cameras. Certain frames are chosen, displayed, and savedin a single video memory based on which of the separate cameras isrecording motion. The method includes recording at specific timeintervals, such as 30 frames per second, the chosen frames into a videofile of the billiard game play. The chosen frames recorded into thevideo file comprise whatever is present at that instant in the singlevideo memory.

Referring again to the example of FIG. 15 , in one exampleimplementation, the video streams from the three cameras 730 and 750 areconnected through USB ports to the second processing device 745 (labeledComputer 2 in FIG. 15 ). The video streams from the three video camerasare connected through USB ports to the processing device 745, alsolabeled Computer 2. In this example, the processing device 745 has anIntel quad-core CPU with hyper-threading, i.e., eight separate logicalCPUs. The operating system for Computer 2 is an Ubuntu system. The eightlogical CPUs can run simultaneously and asynchronously in amulti-threaded, multi-processor environment, such that a separatesoftware thread can be running in each of the eight logical CPUssimultaneously. In the example shown in FIG. 15 and further detailed inFIGS. 18A, 18B and 18C, and Table 6 below, each video stream is input toa separate software module running on its own thread, sharing the memoryallocations listed in Table 6.

TABLE 6 Shared Memory Allocations CFB0 Current Frame Buffer - Camera 0PFB0 Previous Frame Buffer - Camera 0 DIF0 Result of differencecomparison calculation between CFB0 and PFB0 CFLG0 Frame Capture Flag 0PFLG0 ProcessorThread 0 Done Flag CFB1 Current Frame Buffer - Camera 1PFB1 Previous Frame Buffer - Camera 1 DIF1 Difference ComparisonCalculation 1 CFLG1 Frame Capture Flag 1 PFLG1 ProcessorThread 1 DoneFlag CFB2 Current Frame Buffer - Camera 2 PFB2 Previous Frame Buffer -Camera 2 DIF2 Difference Comparison Calculation 2 CFLG2 Frame CaptureFlag 2 PFLG2 ProcessorThread 2 Done Flag THRS Comparison threshold, todetermine motion in Camera 0 view AVGDIF Running average motiondifference calculation for video stream 0 DFB Display Frame MemoryBuffer PIP PIP Image Memory Buffer DFLG DirectorThread Done Flag CTIMECurrent time (in milliseconds) from system clock PTIME Prior time, i.e.the time that the last video frame was put in DFM RFLG Record Flag DONEProcess Done Flag, initialized to NO and set to YES when Process isexited Hardware Device Allocations CAM0 Camera 0 hardware image buffer -generated image available to computer CAM1 Camera 1 hardware imagebuffer - generated image available to computer CAM2 Camera 2 hardwareimage buffer - generated image available to computer File StorageAllocations AVI .avi file storage on system disk or other storage mediaWAV .wav file storage on system disk or other storage media

Turning now to FIGS. 18A, 18B, and 18C, eight flow diagrams are shown1810, 1820, 1830, 1840, 1850, 1860, 1870, and 1880 wherein each flowdiagram represents a separate software thread. A main parent softwareprocess runs from the processing device 745, which launches all of thesethreads asynchronously. However, they may share images and data throughthe use of shared memory resources allocated in the parent process.These shared resources are named and listed in TABLE 6 to enable clarityof presentation and understanding of the action of the differentthreads.

There are three image frame capture threads 1810, 1830, and 1850receiving frame by frame image input from the three camera videostreams. For example, in 1810 CaptureThread 0 receives video input fromthe middle camera 730 in FIG. 7 . Each successive frame of video isavailable in that camera's internal hardware image buffer for 33.3 msec(at 30 frames/sec). At step 1812, the thread moves the image frame fromCAMO internally into the processing device's 745 process allocatedmemory CFB0 for that video stream. At step 1814, the thread sets itsFrame Capture Flag CFLG0 to 1, which then allows the companionProcessThread 0 to compute a difference metric DIF0 between the currentframe and the previous frame PFB0 at 1822. ProcessThread 0 thencontinues to copy the current image in CFB0 to replace the image in theprevious frame buffer PFB0 at step 1824 and then sets its PFLG0 to 1,thus allowing the asynchronously running DirectorThread to use the DIF0value in FIG. 18C to update the AVGDIF. At the same time ImageCapturethreads 1 and 2 1830 and 1850 are operating similarly to acquire imageframes from their respective video cameras 750 in FIG. 7 , andProcessorThreads 1 and 2 1840 and 1860 are operating to compute thedifference metrics DIF1 and DIF2 respectively between their current andprevious image frames. Thus, in this example, six threads, operating onsix separate logical CPUs are operating in this manner to achieve imageframe input from the three video streams.

At the same time that the capture threads are running to acquire images,two other threads, the DirectorThread 1870 and the WriterThread 1880,are running to construct a composite video stream, combining the threeseparate video streams into one final composite stream. This compositevideo is displayed by the DirectorThread, and the DirectorThread 1870determines which frames of video will be used to construct the compositevideo from the three inputs. If the record flag RFLG is set thecomposite video is also stored at 30 frames/sec, and an audio file isalso recorded that is combined with the composite video stream at theend of the process. In this example the SoX Sound Exchange programrunning on the Ubuntu operating system is used to merge the recorded.wav files with the recorded .avi files created by the WriterThread.

The primary input, collected on a frame by frame basis, for thereconstructed composite video comes from camera 0, which is the middlecamera 730 in FIG. 7 , and which provides an overview of the tablesurface. One of the purposes of the composite video is to obtain anaccurate record of ball positioning prior to each shot and during themovement of the balls afterwards. However, there are periods after theballs stop moving where other interesting and informational aspects ofthe play are occurring. The reconstructed composite video captures bothof these activities through the utilization of the 3 cameras andreconstructing one composite video record. As long as motion isoccurring, in the middle camera 730 view, the other two end table videostreams from cameras 750 are not included in the reconstruction. Thedetermination of motion in this example is determined by monitoring thedifference DIF0 between successive frames from camera 0, and computed at1822 in ProcessThread 0 1820. The Director thread computes AVGDIF, arunning average of the last 30 sequential DIF0 values, and compares thisvalue to a fixed threshold THRS to decide if motion is occurring.

Other methods of determining the start of motion, such as using thestriking sound of the cue stick hitting the cue ball (as described inU.S. provisional patent application 62/032,187 and included herein byreference), or by specifically tracking object ball motion, as is wellknown is the art, could also be utilized to determine or define whichframes from the multiple cameras to include in a composite video.

Returning again to the DirectorThread 1870, if all of PFLG0, PFLG andPFLG2 are equal to 1 at 1871, signifying that new image frames are inthe current frame buffers CFB0, CFB1 and CFB2, then the thread proceedsto Copy CFB0 to DFB at 1872. DFB is the memory buffer that displays thecurrent image frame, and it will either be the current CFB0 video framewithout modification, or will later in the thread be overlaid in thecorner with a PIP image. At 1873 the AVGDIF value is updated byaveraging the current DIF0 into the running average, and then at 1874the updated AVGDIF is compared to THRS to decide if motion is present inthe middle camera table view. FIGS. 13A and 13B illustrate the type offrames that are included in the case of detected motion. These figuresare from a sequence of a video frames showing the darker “4 ball” beinghit by the white cue ball, propelling the “4” ball towards the sidepocket. Because the ball motion from these and prior sequential framesresults in an AVGDIF value above the threshold THRS, these frames wouldsimply be added to the reconstructed composite video stream to theexclusion of the end camera views.

If motion is not present at 1874 then the thread compares DIF1 and DIF2at 1875 to see which end view has the most motion going on. The videostream having the most motion as reflected by the higher differencevalue DIF1 or DIF2 will be chosen to provide the end view frame to bereduced in size by ¼ at step 1876 or 1877 and overlaid in a corner ofDFB at step 1879 to create a picture-in-picture reconstructed imageframe. If the difference value DIF1 for video stream 1 is greater thatthe difference value DIF2 for video stream 2, the PIP frame isconstructed 1870 from video frames from video streams 0 and 1. If thedifference value DIF2 for video stream 2 is greater that the differencevalue DIF1 for video stream 1, the PIP frame is constructed 1876 fromvideo frames from video streams 0 and 2. The resulting video framescorrespond to those illustrated in FIGS. 17A and 17B where the end viewframe chosen is the one with the most motion. Thus, the operation of theDirectorThread is to determine if there is motion and choose theappropriate next sequential image frame for the displayed video. Ifthere is no motion on the table, then the reconstructed video shouldshow the activity around the periphery of the table, which is usuallythe player getting ready for the next shot. The PIP frame shows this,but still in the context of the overview of the balls on the tablesurface prior to motion stoppage.

Turning now to step 1880 in FIG. 18C, the WriterThread controls thesynchronization of the process of recording the composite video record.The WriterThread is activated optionally by the operator of theapparatus and in that case the WriterThread is created and started bythe DirectorThread. It also starts the audio recording during itsinitialization and starts a msec clock to measure the recorded frametime interval precisely. Because the audio signal is being recorded inreal time, a composite video stream must be generated that correspondsexactly to the audio record with regard to its visual content. Thus, thethree separate video camera streams can be started and operatedasynchronously in CaptureThreads 0, 1 and 2, and their captured imagescan be subjected asynchronously to image processing in ProcessorThreads0, 1, and 2 to compute a motion analysis metric. And then, theDirectorThread may further select asynchronously and if necessary addPIP frames for inclusion. However, the WriterThread without timevariance must record the contents of the display buffer DFM at exactly1130^(th) of a second to acquire and construct the composite video.Whatever happens to be in the DFM display at that precise time iswritten to the recorded video output file.

The control described above regarding the provided images can beeffected in a number of alternative ways. During a time with no ballmotion, the determination of which end camera view to display can bemade using information from motion sensors disposed on the frame todetect motion in areas around the table corresponding to the respectivefields of view of the respective end cameras. In another approach, oneor more the processing devices can perform image analysis on the videofeeds provided by the respective cameras to determine which camera iscapturing the most motion. The determination of when to remove theoverlaid video feed from an end camera can be made by detecting thesound of the cue striking a ball, image analysis of the video feed fromthe center camera, or a combination of both. For instance, sometimes thecenter camera may capture motion other than that of the balls on thetable such as movement of a cue which can be confused with motion of theballs. Combining image analysis of the balls with sound detection of thestriking cue allows the removal of the overlaid video frame in responseto sound detection of the striking cue and maintaining removal of theoverlaid video frame while detecting ball motion. The processingrequired to effect these actions can done on any combination ofprocessing devices.

Referring to FIG. 19 , another example process executed by the lightingapparatus to automatically provide image storage and/or display fromdifferent cameras based on game play conditions will be described. Inthis example, the processing device is in communication with a middlecamera 730 in FIG. 7 , to capture images of the table surface into videomemory VM2, and cameras 750 at both ends of the frame to respectivelycapture images from opposite ends of the billiard table and first andsecond areas surrounding the respective ends of the table into videomemories VM1 or VM3 respectively, and motion sensors 760 in FIG. 7(labeled MS1 and MS2 in FIG. 19 ) disposed to detect motion in the areassurrounding the opposing ends of the table, and a microphone. Thecameras and motion detectors could be mounted over and/or capturingimages of or sensing motion around sides of the table in addition to orin lieu of the cameras over the ends of the table.

First, the processing device wakes or resets with an initializationprocess 1910. Then, assuming that there is no motion of the balls on thetable, the processing device monitors for motion from the first area andthe second area surrounding the billiard table surface through the useof one or more motion detectors or real time image analysis techniquesdescribed above. Then, the processing device determines at step 1920with respect to detected motion from which camera images should bestored or displayed in video memory VM4 (the output or display/recordedvideo memory). More specifically, in response to detecting motion fromthe first area (or in the case of motion in both areas, where the motionsignal is higher in the first area), the processing device effectsstopping storing or providing images from the second side/end camerainto VM4, and effects storing or providing images 1933 from the firstside/end camera to store or provide images from the first area into VM4.For example, this includes storing or providing video or a video filethat can be played on a display. In response to detecting motion fromthe second area (or in the case of motion in both areas, where themotion signal is higher in the second area), the processing deviceeffects stopping storing or providing images from the first side/endcamera into VM4, and effects storing or providing images 1936 from thesecond side/end camera to store or provide images from the second area.Under either case (same procedure for both steps labeled 1940), theprocessing device next monitors for a ball hit; by detecting motion, forexample, by real time image analysis, and/or by the striking of a ball,for example, by detecting a strike sound having characteristics of a cuestriking a billiard ball. In response to detecting a ball hit, theprocessing device effects stopping storing or providing images from therespective side/end camera into VM4 and effects storing or providingimages VM2 into VM4 at step 1950 from the middle camera' memory VM2 sothat images of the field of view capturing the table and the balls'motion are captured.

The processing device then monitors 1960 for stoppage of the balls'motion, such as through use of one or more motion detectors or real timeimage analysis techniques described above. In response to detectingstoppage of motion of balls on the billiard table surface, theprocessing device effects stopping storing or providing images from themiddle camera and effects storing or providing images from the one ofthe side/end cameras as discussed above. The processing device maydetermine 1970 that the game is finished either by tracking which ballsare on the table with respect to the game being played or by receiving auser initiated signal that indicates completion of play. In response todetermining that the game is finished, the image capture and other gameprocess is ended 1980.

In an additional alternative embodiment, the functionality or logicdescribed in FIGS. 18A, 18B, 18C, and 19 may be embodied in the form ofcode that may be executed in a separate processor circuit. If embodiedin software, each block may represent a module, segment, or portion ofcode that comprises program instructions to implement the specifiedlogical function(s). The program instructions may be embodied in theform of source code that comprises human-readable statements written ina programming language or machine code that comprises numericalinstructions recognizable by a suitable execution system such as aprocessor in a computer system or other system. The machine code may beconverted from the source code, etc. If embodied in hardware, each blockmay represent a circuit or a number of interconnected circuits toimplement the specified logical function(s). Accordingly, a computerreadable medium (being non-transitory or tangible) may store suchinstructions that are configured to cause a processing device to performoperations as described herein.

Those skilled in the art will recognize that a wide variety ofmodifications, alterations, and combinations can be made with respect tothe above described embodiments without departing from the scope of theinvention, and that such modifications, alterations, and combinationsare to be viewed as being within the ambit of the inventive concept.

What is claimed is:
 1. A lighting apparatus for lighting a billiardtable surface, the apparatus comprising: a frame configured to supportone or more lights above the billiard table surface; the one or morelights comprising a light source or sources mounted in the frame in aconfiguration to provide substantially uniform illumination from cushionto cushion of the billiard table surface; a first camera disposed tocapture images of a first area relative to the billiard table surface; asecond camera disposed to capture images of a second area relative tothe billiard table surface; a processing device in communication withthe first camera and the second camera and configured to provide imagesto a display device; wherein the processing device is configured to:monitor motion from the first area and the second area, in response todetecting motion from the first area (or in the case of motion in boththe first area and the second area, where a motion signal is higher inthe first area), effect stopping storing or providing images from thesecond camera and effect storing or providing images from the firstcamera to store or provide images from the first area.
 2. The lightingapparatus of claim 1 wherein the processing device is further configuredto, in response to detecting motion from the second area (or in the caseof motion in both the first area and the second area, where a motionsignal is higher in the second area), effect stopping storing orproviding images from the first camera and effect storing or providingimages from the second camera to store or provide images from the secondarea.
 3. The lighting apparatus of claim 1 wherein the processing deviceis further configured to detect stoppage of ball motion on the billiardtable surface and, in response to detecting stoppage of motion of ballson the billiard table surface, effect stopping storing or providingimages from the first camera and the second camera.
 4. The lightingapparatus of claim 3 wherein the processing device is further configuredto, in response to detecting stoppage of motion of balls on the billiardtable surface, effect storing or providing images of the billiard tablesurface.